A Robust and Generic Discourse Model for Multimodal Dialogue
نویسندگان
چکیده
We present an implemented, well-tested discourse model used in several monoas well as multimodal dialog systems. We provide a detailed description of the underlying representation and show how such challenging phenomena like cross-modal anaphoric expressions and ellipses are processed.
منابع مشابه
Enabling robust and fluid spoken dialogue with cognitively impaired users
We present the flexdiam dialogue management architecture, which was developed in a series of projects dedicated to tailoring spoken interaction to the needs of users with cognitive impairments in an everyday assistive domain, using a multimodal front-end. This hybrid DM architecture affords incremental processing of uncertain input, a flexible, mixed-initiative information grounding process tha...
متن کاملRecent Trends in Discourse and Dialogue Recent Trends in Discourse and Dialogue
We describe a generic set of tools for representing, annotating, and analysing multi-party discourse, including: an ontology of multimodal discourse, a programming interface for that ontology, and NOMOS – a flexible and extensible toolkit for browsing and annotating discourse. We describe applications built using the NOMOS framework to facilitate a real annotation task, as well as for visualisi...
متن کاملA Model of Authors’ Generic Competence of EAP Research Articles: A Qualitative Meta-Synthesis Approach
Genre analysis as an area of great concern in recent decades, involves the observation of linguistic features used by a determined discourse community. The research article (RA) is one of the most widely researched genres in academic writing which is realized through some rhetorical moves and discursive steps to achieve a communicative purpose. This study aimed at proposing a model of generic p...
متن کاملHybrid discourse modeling and summarization for a speech-to-speech translation system
This thesis describes the result of several years of research focusing on a small part of natural language processing: with an overall goal of languageindependence, a robust approach to dialogue modeling and discourse processing. The main context in which the approach has been developed is VerbMobil—a project for a speech-to-speech translation system for spontaneously spoken negotiation dialogu...
متن کاملContext based multimodal interpretation: an integrated approach to multimodal fusion and discourse processing
This dissertation addresses the problem of designing a comprehensive context model thatenables the interpretation and integration of verbal and nonverbal contributions during dyadicas well as multiparty human-computer interactions. When people engage in conversation, theymake use of a variety of nonverbal behavior (e.g., facial expressions, eye gaze, head movement,hand gestures,...
متن کامل